Papers with addressing hallucination
CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 Languages (2024.lrec-main)
Copied to clipboard
Thuat Nguyen, Chien Van Nguyen, Viet Dac Lai, Hieu Man, Nghia Trung Ngo, Franck Dernoncourt, Ryan A. Rossi, Thien Huu Nguyen
| Challenge: | Existing training datasets for large language models are often not fully disclosed. |
| Approach: | They propose a multilingual dataset with 6.3 trillion tokens in 167 languages . they use a pipeline of multiple stages to achieve the best quality for model training . |
| Outcome: | The proposed dataset is cleaned and deduplicated to achieve the best quality for model training . lack of transparency has hindered research on attributing and addressing hallucination and bias issues . 6.3 trillion tokens in 167 languages are used to train multilingual LLMs . |
Knowledge Graph-Guided Retrieval Augmented Generation (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing studies on RAG focus on semantic retrieval of isolated relevant chunks, which ignore their intrinsic relationships. |
| Approach: | They propose a framework that utilizes knowledge graphs to provide fact-level relationships between chunks, improving the diversity and coherence of the retrieved results. |
| Outcome: | Extensive experiments on the HotpotQA dataset and its variants demonstrate the advantages of KG2RAG compared to existing RAG-based approaches in terms of response quality and retrieval quality. |
What if...?: Thinking Counterfactual Keywords Helps to Mitigate Hallucination in Large Multi-modal Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to reduce hallucination in large multi-modal models are lacking in addressing this problem. |
| Approach: | They propose a method that implants counterfactual thinking into Large Multi-modal Models using self-generated counterfact keywords into the models. |
| Outcome: | The proposed method improves the reliability of large multi-modal models in addressing hallucination. |
A Comprehensive Survey of Hallucination in Large Language, Image, Video and Audio Foundation Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | a growing need to understand and alleviate FMs' propensity to produce hallucinated outputs, especially in high-stakes applications. |
| Approach: | They propose a framework for detecting and mitigating hallucination in FMs . they synthesize recent advancements in detection and mitigation techniques . |
| Outcome: | The proposed framework provides valuable insights for researchers, developers, and practitioners. |